Mobile application interactive user interface for a remote computing device monitoring a test device

ABSTRACT

Remotely monitoring a test on a test specimen includes receiving information pertaining to the test, rendering on a remote computing device display an information message having portions indicative of a testing device, of information related to the testing device or a test being conducted on the testing device, and of time that has elapsed since the second portion has occurred, and updating the third portion indicative of the time that has elapsed. A test operation monitoring system includes an image capture device, and a computing device operatively connected to the image capture device to receive information on the testing operation from the image capture device, the computing device having a controller configured to receive information pertaining to the testing operation and to render on a display an information message indicative of parameters of the testing device at a selectable amount of progress through the testing operation.

RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Application Ser.No. 61/884,928, filed Sep. 30, 2013, having the same title, and ishereby incorporated by reference in its entirety.

BACKGROUND

United States Patent Application Publication: US 2013/0212512A1, whichis incorporated herein by reference in its entirety, describes a systemor operating architecture that allows among other concepts describedtherein, an apparatus and method to provide remote access to data, andin particular test data and/or other information from a test machineused for example to test performance of consumer products, materials,components, structures, etc. Improvements regarding the data obtainedfrom the testing devices and/or rendering such information to the userof a mobile or remote device in a manner that is convenient for the useris always desired.

SUMMARY

This Summary and the Abstract herein are provided to introduce aselection of concepts in a simplified form that are further describedbelow in the Detailed Description. This Summary and the Abstract are notintended to identify key features or essential features of the claimedsubject matter, nor are they intended to be used as an aid indetermining the scope of the claimed subject matter. The claimed subjectmatter is not limited to implementations that solve any or alldisadvantages noted in the Background.

An aspect of the invention provides a method of remotely monitoring atest being performed upon a test specimen, comprising receivinginformation pertaining to the test, rendering on a display of acomputing device remote from the testing device an information messagehaving a first portion indicative of a testing device, a second portionindicative of information related to the testing device or a test beingconducted on the testing device, and a third portion indicative of timethat has elapsed since the second portion has occurred, and updating thethird portion indicative of the time that has elapsed.

Another aspect of the invention provides a computing device, comprisingan interface configured to receive information pertaining to a testperformed on or related to a testing device, a storage device, adisplay, and a processor operably connected to the interface, thestorage device and the display, the processor configured to receiveinformation pertaining to the test; to render on the display aninformation message having a first portion indicative of the testingdevice, a second portion indicative of information related to thetesting device or a test being conducted on the testing device, and athird portion indicative of time that has elapsed since the secondportion has occurred; and to update the third portion indicative of thetime that has elapsed.

Still another aspect of the invention provides a system configured tomonitor a testing operation on a testing device, comprising an imagecapture device, and a computing device operatively connected to theimage capture device to receive information on the testing operationfrom the image capture device, the computing device having a controllerconfigured to receive information pertaining to the testing operationand to render on the display an information message indicative ofparameters of the testing device at a selectable amount of progressthrough the testing operation.

Another aspect of the invention provides a system configured to monitora testing operation on a testing device, comprising an image capturedevice, and a computing device operatively connected to the imagecapture device to receive information on the testing operation from theimage capture device, the computing device having a controllerconfigured to receive information pertaining to the testing operation;to render on the display an information message having a first portionindicative of the testing device, a second portion indicative ofinformation related to the testing device or a test being conducted onthe testing device, and a third portion indicative of time that haselapsed since the second portion has occurred; and to update the thirdportion indicative of the time has elapsed.

Yet another aspect of the invention provides a testing device;comprising a test platform having a controller operatively coupled tothe test platform, an image capture device operatively coupled to thecontroller, to capture information pertaining to a test, the testplatform, or a test specimen on the test platform, wherein thecontroller is configured to generate an information message having afirst portion indicative of a testing device of the one or more testingdevices, a second portion indicative of information related to thetesting device or a test being conducted on the testing device, and athird portion indicative of time that has elapsed since the secondportion has occurred.

Another aspect of the invention provides a mobile application toolincluding instructions stored on a computer storage medium and operablethrough one or more hardware components of a computing device,comprising a mobile test interface component configured to retrieve aninformation message, from one or more testing devices, associated withone or more tests operable on the one or more testing devices, and adisplay component configured to invoke a graphical user interface todisplay the retrieved information message, the information messagehaving a first portion indicative of a testing device of the one or moretesting devices, a second portion indicative of information related tothe testing device or a test being conducted on the testing device, anda third portion indicative of time that has elapsed since the secondportion has occurred.

Yet another aspect of the present invention provides a mobile dataplatform for monitoring a testing system including one or more testingdevices operated through one or more controller units, comprising acommunication platform to receive information on one or more testsoperable on the one or more testing devices, and a display componentconfigured to invoke a graphical user interface to display the receivedinformation, wherein the received information is determined byparameters identified by an individual user for that individual user.

Additional aspects of the invention include the following and may becombined with any of the above aspects and with each other as desired.

An aspect wherein the information pertaining to the test includes anindication of a test failure, and wherein rendering further comprisesrendering an information message about the failure.

An aspect wherein the information pertaining to the test includes animage or video of the failure, and wherein rendering further comprisesrendering a link to the image or video of the failure.

An aspect wherein the information pertaining to the test includes animage or video of the testing operation, and wherein rendering furthercomprises rendering a link to the image or video.

An aspect further providing receiving information pertaining to an alertpertaining to the test, the testing device, and/or a componentassociated with the testing device, and rendering the alert on thedisplay.

An aspect further providing rendering on the display a series ofinformation messages in a time ordered fashion such that each thirdportion of each information message in the series of informationmessages continues to indicate the elapsed time from the correspondingsecond portion of each information message as the information message isrendered on the display.

An aspect wherein the series of information messages relates toinformation provided by at least two different testing devices.

An aspect wherein the series of information messages relates only totesting devices, a component connected thereto, and/or communicationbetween users authorized to monitor the information messages.

An aspect further providing associating graphical icons for informationmessages.

An aspect further providing associating images of a testing device withan information message for that testing device.

An aspect further providing receiving information from the user of thecomputing device indicating at least one parameter associated with thetesting device, a component connected thereto, and/or communicationbetween users authorized to monitor the information messages to be sentin an information message.

An aspect wherein the processor is further configured to receive animage or video associated with the testing operation, and to render onthe display the image or video associated with the testing operation.

An aspect wherein the image capture device is configured to captureimages of the testing operation, and to convey to the computing deviceimages associated with the testing operation.

An aspect wherein the image capture device is configured to conveyimages associated with a failure of the testing operation to thecomputing device upon the failure.

An aspect wherein the image capture device is configured to capture avideo of the testing operation, and to convey to the computing devicevideo associated with the testing operation.

An aspect wherein the image capture device is configured to convey videoassociated with a failure of the testing operation to the computingdevice upon the failure.

An aspect wherein the controller is further configured to render on thedisplay an alert for a condition of the testing device.

An aspect wherein the tool includes an alert function which whenactivated retrieves alert notifications for the one or more testingdevices.

An aspect further providing an alert function to provide an informationmessage indicating a completion of a test cycle or test for a testingdevice of the one or more testing devices.

An aspect wherein the received information is rendered on the displaycomponent and includes an information message having a first portionindicative of a testing device, a second portion indicative ofinformation related to the testing machine or a test being conducted onthe testing device, and a third portion indicative of time that haselapsed since the second portion has occurred.

An aspect wherein the received information third portion is updatedindicative of the time has elapsed since an event associated with theinformation message has occurred.

Other aspects of the invention include a computing device, a system,and/or a mobile tool for implementing any of the methods of claims 1-11.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an embodiment of a mobile device and rendereddisplay.

FIG. 2 illustrates a screen shot of a parameter selection according toanother embodiment.

FIGS. 3, 4, 4A-4B, and 5-12 illustrate screen shots according to otherembodiments.

FIG. 12A illustrates an embodiment of a system according to anotherembodiment.

FIGS. 13-19 illustrate screen shots according to other embodiments.

FIG. 20 illustrates an embodiment of a remote test platform forproviding access to test data and status for a test device.

FIGS. 21-22 illustrate an embodiment of a communication sequence forinterfacing with a remote test platform illustrated in FIG. 1.

FIG. 23 illustrates an embodiment of a remote test platform forproviding access to test data and status for a plurality of test devicesin a laboratory facility.

FIGS. 24-25 illustrate embodiments of a remote test platform utilizingimage or bar codes to identify testing devices or components to accessstatus information and data therefor.

FIG. 26 illustrates steps for utilizing an image or bar code asillustrated in FIGS. 5-6.

FIG. 27 illustrates a display bar for implementing functions of themobile test platform.

FIGS. 28-30 illustrate GUI displays for a computing device configured tointerface with the remote test platform to access test data and status.

FIG. 31 illustrates an alert notification generated by an alert functionof the mobile test platform.

FIG. 32 illustrates an embodiment of a messaging function of the mobiletest platform

FIG. 33 illustrates an embodiment of a cloud computing platformincluding maintenance, tech support, product/accessory and usagemeasurement tools.

DETAILED DESCRIPTION

An aspect of the present invention is a user interface 10 that providesinformation related to changes in one or more testing devices such asthose illustrated and described in US 2013/0212512A1. By way of example,the user interface 10 can be rendered on any suitable computing device11 such as mobile phone 156, tablet computing device 157, portablecomputing device 158 (the aforementioned all being examples of “mobile”computing devices) or other computing devices remote from the testdevices as illustrated and described in US 2013/0212512A1. It should benoted that although the user interface discussed herein is suitable forthe architecture illustrated and described in the afore-mentioned USpublished patent application where the remote computing devicescommunicates with a remote test platform or cloud computing platformusing any wired or wireless communication link, the user interface 10can be rendered on any of the afore-mentioned computing devices that isalso in direct communication with the testing device(s) such as a systemcontroller 134 or other computing device such as 1120 described belowand associated with the testing device(s). The remote computing devicein one embodiment is not the computing device used to conduct a test onor to control the testing device, such as a mobile device as describedabove or a desktop computer receiving information from a local areanetwork or wide area network. The “remote” computing device is not inclose proximity to the testing device in one embodiment.

The user interface 10 comprises a time-ordered sequence of renderedinformation messages herein exemplified as 12A, 12B, 12C. Eachinformation message 12A-12C typically is associated with a single testdevice or apparatus. Referring to information message 12A by way ofexample, each message typically includes a test device identifier 14 andan associated descriptive action portion 16, which together provide theuser of the remote computing device a brief and convenient descriptionof which testing device the message pertains to and the action or eventthat has occurred. As illustrated, each information message 12A-12C canfurther include a representative graphical image 18 such as a smallpicture of the testing device, or a picture representing the testingdevice. The graphical image 18 also aids the user to correctly associatethe actual testing device to the information message. The graphicalimage 18 can be stored in memory on the remote computing device andrendered together with the information message. In this embodiment, theprocessor of the remote computing device can process some identifier inor associated with the information message received by the remotecomputing device in order to obtain the correct graphical image storedtherein. If desired, the graphical image can be sent by the testingdevice with the other information comprising the information message.

If desired, software modules used to render each of the informationmessages can further render one or more graphical icons 20 which canfurther aid the user in ascertaining the action that the testing devicehas taken. For instance, a stop sign graphical icon can indicate, asillustrated in information message 12A, that the associated testingdevice has stopped, while a graphical icon indicative of an arrowhead,as illustrated in information message 12C, can be used to indicate thatthe associated testing device has started operation of a test. As withthe graphical image 18, the graphical icon 20 can be sent with the otherinformation comprising the information message and/or be rendered by theprocessor of the remote computing device based on the descriptive action16 or other icon identifying sent with information comprising theinformation message.

Other graphical icons can be further rendered if desired. Referring backto information message 12A, a graphical icon illustrating a bellindicates that an alert has been sent typically using a different formof communication such as via email, text message, etc. The alert istypically associated with an event that the remote computing device useror others are particularly concerned with. The alert graphical icon canindicate to the user the importance of the event as well as indicatethat others interested in operation of the testing device will receivethe alert message as well.

Each information message 12A-12C further includes an elapsed timeindicator 22 indicative of the amount of time that has lapsed since theoccurrence of the change in status of the testing device indicated byidentifier 14 and descriptive action 16. Unlike a message such as analert or other message that would include a time stamp that is rendered,the elapsed time indicator 22 can be considered a more readable formatthat conveys to the user the amount of time the has elapsed since theevent has occurred, which again can be of aid in ascertaining theimportance of the information message.

In a preferred embodiment, the amount of time that has lapsed in portion22 indicated in each information message 12A-12C is continually updatedand rendered on the user interface 10 if the information message isdisplayed. Therefore, even if no new information messages are receivedfor a period of time, the elapsed time indicator 22 will increase withtime. Typically, values rendered comprising whole numbers of minutesand/or hours and/or fractions thereof since the activity indicated inthe information message has occurred is sufficient; however, if desiredtime elapsed as measured in seconds, days and/or weeks, etc. can berendered, if desired or needed by the testing device and/or the testbeing performed thereon. For instance, if the event is in a precedingday, the portion 22 could refer to previous days such as but not limitedto ‘Yesterday at 2:35” or “Tuesday at 4:50 pm”. Likewise, the timeportion could refer to a specific day, particularly, when it is apreceding day, for example, greater than a week, e.g. “Sep 3^(rd) at12:04 am”. It should be noted that the time indicator can furthercomprise in the alternative or in addition a time stamp indicative ofwhen the event took place.

In the embodiment illustrated individuals responsible for the testingdevice or the test being conducted on a testing device can also beincluded in the information message. For example, F. Stephan Kirschbaumis the engineer responsible for the tests being conducted on testingdevice “HF MAST #2” in information message 12A, while the operatorconducting the test is Nicholas Kreidberg. In this manner, the user ofthe computing device having the user interface 10 can easily ascertainwhich individual to contact concerning the event and/or testing deviceassociated with the information message.

As indicated above, the information messages 12A-12C are arranged in asequence with the most current information message displayed at the topof the user interface 10. Those information messages that have occurredearlier may or may not be displayed on the computing device with thelatest information message. Earlier information messages however can berendered to the user by scrolling through the time ordered sequence ofinformation messages using a suitable input device such as a pointingdevice (e.g. mouse, physical button, visually rendered button on thedisplay, etc). In the embodiment illustrated where the user interface 10is rendered on a smart phone 11 having a pressure sensitive screen, theuser can simply use his or her finger to scroll up or down through theinformation messages.

Referring to FIG. 2, an embodiment of the user interface 10 can alsocomprise information messages related to periodic updates concerning thetest being conducted on the testing device. Information message 12B isexemplary. In this example, the information message 12B conveys that thetest device “Frame #1” has completed 50% of the test being conductedthereon and is at 600 cycles through the testing procedure. The periodicupdate frequency for each testing device of interest to the user can beaccessed through a suitable menu such as illustrated at 40 that can berendered on the computing device. In the embodiment illustrated, theuser can adjust the time period by entry of values in input boxes 42 and44. The user can select any or all of the information pertinent to thetesting device at input box 46. Selection boxes 48 and 50 turn off or onthe periodic updates, respectively. Upon completion of the data entryvia menu 40, information concerning the requested periodic updates issent to the computing device or controller of the testing device,directly or via a server platform as described in the aforementionedpublished US patent application in order to incorporate the requestedupdates in the testing procedure and send them accordingly. It should benoted that the requested updates can be associated with the remotecomputing device user such that the requested periodic updates are sentonly to the requesting remote computing device user and not to otherremote computing device users. The information generated by thecomputing device or controller of the testing device for eachinformation message can include identifying information as to whichremote computing device user is to receive the information messageand/or the server platform in the aforementioned US published patentapplication can control which information message is sent to each remotecomputing device.

Referring to FIG. 3, in another embodiment, additional informationrelated to the information message being rendered in the time sequencecan also be obtained. In the embodiment illustrated, selectinginformation message 12B on user interface 10 would render additionalinformation illustrated in screen shot 51. In the embodiment of the userinterface 10 on a smart phone 11, screen shot 51 would replace thetimeline sequence of user interface 10. In screen shot 51, theinformation message 12B is repeated; however, if desired, a time stampindicative of the time in which the event for the information messageoccurred can be provided such as at 52. The additional informationconveyed to the user can take any number of forms. In this example, theadditional information includes identifier 54 indicative of the testbeing conducted on the testing device associated with informationmessage 12B. Operation of button 56, which can be a physical button or abutton rendered on the display, returns the computing device todisplaying the timeline sequence of user interface 10. In yet a furtherembodiment illustrated in screen shot or page 50, this page can includea link (e.g. the equipment name) to a profile page 57 for the equipment.This page 57 is a focused view for a specific piece of equipment, withreal-time indicators of the current status, other high level status, andlinks to related information. For example and not as a limitationadditional links can include a links to User Documentation for thatspecific equipment, when it was last serviced, it's specification suchas maximum load capacity, etc. In another embodiment, an equipmentpicture, name and high level information may all be displayed on themain screen of the display, and tapping takes a user directly to ascreen such as screen 57.

FIG. 4 illustrates an exemplary menu of another embodiment that allowsthe user to access parameters that are used by the software moduleexecuted by the processor of the computing device 11 generating userinterface 10. Menu 60 can include account information of the user andthe ability to log in or activate the software module so as to receiveinformation messages at 62. “Logging in” typically establishes acommunication link with the server and/or the computing device orcontroller of the testing device. Input selection 64 allows the user toenter information or otherwise access information pertaining to his orher account. As described in US Published Patent Application2013/0212512A1, ID or identifier codes associated with each physicaltesting device such as a bar or QR code can be used by the user of thecomputing device to identify which testing device he or she would liketo monitor. In the embodiment illustrated these ID codes comprise QRcodes which are accessible by input selection 66.

In FIG. 4, the “View” selection under “Alerts” when selected renders ascreen like that illustrated in FIG. 4A. From this screen, the remotecomputing device user can set up alerts, where an alert is acommunication sent by another method such as but not limited to by emailor text message. In this manner, if the user it at his desktop and/ordoes not have his or her remote computing device phone powered, or theremote monitoring application enabled, the user will receive the alertmessage. From this screen, the remote computing device user can easilytoggle alerts on or off as desired once they have been set up on asuitable menu not shown. Changing the alert status, typically is sent tothe computing device or controller of the testing device and/or theserver so that alerts are sent out through the other communication modesas needed.

In FIG. 4B, the “Sent” selection under “Alerts” when selected renders ascreen like that illustrated in FIG. 4B in one embodiment. This screenallows the remote computing device user to see the alerts that have beensent out, commonly in reverse chronological order, although if desiredany desired order can be provided as requested by the remote computingdevice user.

A particular advantageous feature of the user interface 10 is theability of the user to adjust or change which test devices the user isinterested in monitoring. In other words, the user interface 10indicates which testing devices the user wants to receive informationmessages related thereto. In menu 60 the user can indicate by selectionof menu item 68 the equipment or which testing devices to receiveinformation messages from. Activation of button 68 can comprise in oneembodiment an input signal to the software module executing on theremote computing device to render a menu 70 such as illustrated in FIG.5. Menu 70 can include a listing 71 of all the testing devices(scrollable if necessary) that the user has selected or is authorized tomonitor. In the embodiment illustrated, for each test device anassociated button 72 is provided that can be activated or deactivateddepending upon the users desire to monitor the associated testingdevice.

Referring back to FIG. 4, in one embodiment menu 60 can also include aselection button 69 to allow the user to identify which types ofinformation or activities of the testing device(s) that the user desiresto monitor. Activation of input selection 69 can render a menu 80 asillustrated in FIG. 6. Generally, the activities can be grouped forexample based upon the status of the test being conducted on the testingdevice such as indicated by activities associated with buttons 82, 84and 86 or information associated with operational status of componentsof the testing device such as activities associated with buttons 83, 85and 87. Selection of buttons 82, 84 and 86 allow the user to enable ordisable information messages being rendered on the user interfacerelated to when the test program stops, is on hold, or is running,respectively. Likewise, buttons 83, 85 and 87 allow the user to enableor disable rendering of information messages pertaining to theoperational status of a physical component of the testing device, hereinillustrated as the hydraulic service manifold “HSM.” As appreciated bythose skilled in the art these are just but a few examples and will varydepending upon the test being conducted and/or the various physicalcomponents comprising the testing device. The information pertaining towhich testing device(s) the remote computing device user would like tosee corresponding information messages (as selected from menu 70) aswell the information messages for the particular activities (as selectedfrom menu 80) can be stored in memory of the corresponding computingdevice or controller of the testing device or in memory of the serverconnected thereto with respect to the remote computing device in thesystem of the aforementioned US published patent application wherein theprocessor of the computing device or controller of the testing device orthe processor of the server access this stored information in order togenerate and send the information message to the remote computingdevice. In another embodiment, the information pertaining to whichtesting device(s) the remote computing device user would like to seecorresponding information messages (as selected from menu 70) as wellthe information messages for the particular activities (as selected frommenu 80) can be stored in memory of remote computing device wherein theprocessor of the remote computing device accesses this storedinformation in order to render the information message on the remotecomputing device 11. In yet another embodiment, final rendering of theinformation message on the remote computing device can be due to acombination of whether the information message is generated on acomputing device remote from the computing device 11 and/or whether, ifreceived by the remote computing device 11, the information message isrendered on user interface 10 by the processor of the remote computingdevice 11.

Referring to FIG. 7, as indicated above the information message caninclude for example names of individuals related to the associatedtesting device. Although not illustrated in menu 60 of FIG. 4, it shouldbe noted that if desired a filtering button can be provided in menu 60to identify to the user that he or she can receive information messagesfrom testing devices based upon the individuals associated with thetesting devices. Hence, if desired, the user can indicate that he or shedesires to receive information messages for testing devices associatedwith one or more particular individuals associated with various testingdevices. This is particularly advantageous for the user to use to onlyview activities and equipment of things that he or she is assigned as anoperator, engineer or lab manager, in which case the manager could forexample list specific equipment, operators and/or engineers.

Referring to FIGS. 8-11, user interface 10 can also include in variousembodiments an overview display that lists each of the testing devicesthat the user of the computing device is interested in or authorized tomonitor. Referring to FIGS. 8 and 10, the testing devices can be groupedtogether, for example, based on testing location, such as whichlaboratory, with user adjustable identifiers 100 and 102 as needed. Inthe example illustrated, two testing devices are associated withlocation identifier 100, while four testing devices are associated withlocation identifier 102.

Each listed testing device is in fact a user selectable button whereuponactivation by the user, the user will obtain additional informationregarding the testing device such as illustrated in FIG. 9 at 104.Generally, the detailed information can include the current runningstatus of the testing device, the test being conducted, if any, thelocation in the laboratory of the testing device as well as theassociated individuals relevant to the testing device or the test beingconducted on the testing device including parameters of the testingdevice identified by operational identifiers generally indicated at 108.The operational identifiers can be color coded to indicate whether ornot the particular parameter of the testing device is enabled ordisabled. Likewise, each of the identifiers having the testing devicename and comprising the user selectable buttons (for example at 106) canalso be color coded to indicate the operational status of the testingdevice. For example, if a testing device is not running a test the userselectable button for the testing device can be red, while if thetesting device is operating a test, the user selectable button can beidentified as green.

One particularly advantageous and informative information message isillustrated in FIG. 12. Specifically, if desired, the informationmessage can include a photo or picture taken by a camera locatedproximate the testing device so as to provide a picture of the testingdevice, a component thereof, and/or the test specimen under test. In theexamples provided information message 120A is indicative of a firstportion of a test sequence performed on a test specimen being completedwith an associated photo 120B (which in the illustration of FIG. 12 isincomplete). Likewise, information message 122A is another informationmessage indicative of another portion of the test sequence beingcompleted and a photo 122B of the test specimen 124 under test.Information message 126A is indicative of the test stopping with theassociated photo 126B. In information message 126A, the test specimen124 has failed or broke which thereby stopped the test.

FIG. 12A schematically illustrates one embodiment of a system to whichthe information messages 120A, 122A and 126A pertain. In FIG. 12 A thetesting device is indicated at 130 while an image capture device such ascamera 132 is arranged so as to take images of the testing device, acomponent thereof, and/or the test specimen under test. Camera 132 isoperatively connected to a controller 134 or other computing deviceassociated with testing device 130. Computing device or controller 134can communicate with a cloud based server platform 136 which in turncommunicates with the mobile or otherwise remote computing device 138upon which the information messages 120A, 122A and 126A are rendered.This architecture or system configuration is similar to that describedin US published patent application 2013/0212512A1. However, it should benoted that in an alternative embodiment the remote computing device 138can be operably connected directly to the computing device 134 of thetesting device 130 either through wireless and/or wired directcommunication links, i.e. without a server platform as described in USpublished patent application 2013/0212512A1, or at least not providingall the functionality described therein.

It should be noted that the information messages 120A, 122A and 126A canbe configured so as to render the image with rendering of theinformation message. In the alternative, a user activated button or URL“universal resource locator” link can be rendered in the informationmessage and selected by the user, wherein upon selection the remotecomputing device then accesses or downloads the associated image from astorage device remote from the computing device such as in the cloudbased server 136 or the computing device 134 associated with the testingdevice 130 to obtain the requested image.

In a manner similar to providing a static image in the informationmessages, FIG. 13 illustrates that information messages can include userselectable buttons or links to video sequences pertaining to theassociated information message. In FIG. 13, the same events as describedwith respect to information message 120A, 122A and 126A are illustrated;however, in this form of information message, a user selectable image140B, 142B and 146B are associated with a video sequence pertaining tothe event that caused generation or rendering of the informationmessage. The video sequences 140B and 142B can, for example, beindicative of the last few seconds before completion of the indicatedportion of the test sequence. In one embodiment this is achieved byrecording continuously into a circular storage buffer that can hold 5,10, or X seconds of video. When the event occurs, the video from thecircular buffer is stored as an individual clip. In this manner, theprevious 10 seconds of footage are always available, so when an eventoccurs, the 10 seconds leading up to the event are available and can bestored. A variable amount of time after the even can also be recorded tocapture the “before” and “after” of the event. Information message 126Apertains to the testing device stopping and selection of the userselectable image 146B causes generation or rendering of the associatedwith a video sequence, which could include showing the test beingstopped and/or the specimen failing.

The same components as illustrated in FIG. 12A can be used to captureand store the video sequences for the information messages. In oneembodiment, all the video can be stored in the computing device of thetesting device 130, the server 136 and/or even in the remote computingdevice 138 and accessed as needed to render the information message. Inanother embodiment, the video can be stored in a circular storage bufferof any of the aforementioned devices with the relevant video sequenceportion saved or otherwise made accessible for association with theinformation messages generated and sent to the remote computing deviceor rendered thereon. In an additional embodiment, one large video filecan be captured, or large partitions. An index into this file can bestored at the time of the event, allowing a variable time before andafter the event to be viewed remotely.

In the illustrated example of FIG. 14, testing device HF MAST #2 isbeing monitored remotely by two different users using two differentremote computing devices. In this example upon receipt of informationmessage 150, the remote monitoring user, Andrew Frenz, entered a commentto be associated with information message 150. His comment is indicatedat 152. Upon entry of any comment, the information message 150 can beaugmented to include an icon 154 indicating that a comment is nowassociated with information message 150. In this example, the operator,Nicholas, having probably noticed that his information message 150 onhis remote computing device now includes the graphical icon 154. Uponhis selection of the information message 150, he can respond to AndrewFrenz's comment 152 as indicated at 156. Any number of comments can beentered by any remote computing device user monitoring the testingdevice HF MAST #2. In this example, the comments are entered byselecting the information message 150 whereupon the remote computingdevice generates or displays details of the testing devices such asillustrated in screen shot 158. Typically, the comments 152, 156 arestored in association with the information message (which is alsostored) on either the computing device or controller of the testingdevice and/or the server in communication therewith as described in thesystem of the aforementioned US published patent application.

FIG. 15 illustrates another form of information message 170 hereinpertaining to a particular testing device HF MAST #2. In one embodiment,the remote computing user can access the associated equipment forexample as available in the overview view displays of FIG. 8-11 wherethe remote computing device user can select the particular testingdevice to post a comment related thereto. The comment can remainassociated with the particular testing device such that any other userupon selection of the testing device from the overview menu, or anyremote computing device user monitoring the testing device forinformation messages would then see the comment that has been posted.Typically, the information message comment 170 is stored in associationwith the corresponding testing device on either the computing device orcontroller of the testing device and/or the server in communicationtherewith as described in the system of the aforementioned US publishedpatent application. FIG. 16 illustrates another form of informationmessage 180 that is rendered to any remote computing device user. Inthis example, the information message 180 does not pertain directly toany specific testing device, but rather, to the testing laboratory ingeneral. The information message again is stored on either the computingdevice or controller of the testing device and/or the server incommunication therewith as described in the system of the aforementionedUS published patent application.

At this point it should be noted as illustrated in FIG. 19 thatrendering of information messages is commonly displayed in reversechronological order (i.e. the latest first); however, in otherembodiments it may be advantageous to render them in a different ordersuch as “pseudo-chronological” order, i.e. where at some are rendered ina chronological (reverse chronological) with others for example takingpriority. For example, based on some indication of priority, the remotecomputing device could render information messages based on priority.The priority indication can be associated with the information messageitself (either explicitly being rendered as such, or be associated withthe information message but the indication not necessarily rendered. Theindication of priority can be assigned at the testing device, i.e. bythe operator of the testing device, by encountering an informationmessage element in the test procedure (discussed below), by the senderof the information message either actively marking it as such, Prioritycould also be based upon the sender's name, position in company, orrelation to the testing machine or test being performed. This prioritycan be determined by processing the information message, which can occuron the computing device or controller of the testing device, the serverplatform and/or the remote computing device. The priority of informationmessages can be determined by combinations of any of the above as well.

The priority information message can remain displayed as the firstinformation message on the display, or otherwise near the top of thereverse chronological order for a set period of time such as but notlimited to being set by sender of the information message, the remotecomputing device user, and/or until being acknowledged or viewed by theremote computing device user.

Some of the information messages discussed above such as informationmessage 12A, 12C are based on the operational status of the testingdevice, for example, when the testing device stops or is started. Asdiscussed with respect to FIG. 2, the user of the remote computingdevice can indicate that he or she desires periodic updates regardingthe tests being performed. The remote computing device will take asinput the parameters regarding the periodic updates such as the testingdevice name or other identifier, how frequently updates are to beprovided, and the content of the information to be contained in theinformation message and communicate that information back to the testingdevice such as the system controller of the testing device or othercomputing device connected thereto so that when the test program beingrun on the testing device reaches the end of the time period selected,the information message is than generated and transmitted to the remotecomputing device. It should be noted that the information message neednot be always generated by the controller or computing device associatedwith the testing device.

For instance, in the system architecture of US Published PatentApplication 2013/0212512A1 if the relevant information needed togenerate the information message is known to the server, or even theremote computing device, these computing devices can also generate theinformation message to be rendered on the remote computing device.

In a further embodiment, information messages can be defined during testprogram or procedure development. For instance, US Published PatentApplication 2010/0077260A1, which is incorporated herein in its entiretyby reference, describes a method and system for creating a testprocedure using a graphical user interface to arrange and schematicallyconnect test procedure elements to create the test procedure representedby connected graphical icons.

Briefly, a test procedure can be considered to be a flow chart ofactions with a beginning, and end, and a sequential flow from start tofinish to control a controllable element of a testing device. Testingprocedures can incorporate parallel branches that operate simultaneouslyor based on conditions or looping, but ultimately they progress from theinitial action to the final action. The building blocks of the testprocedure comprise events, actions conditions and steps. An event canstart or initiate a portion of a testing procedure. An action is anactivity that is preformed within the testing procedure. Conditionsinteract with conditional logic so that a rule may establish a conditionwhere the associated action is performed only if that condition is trueor otherwise met. There can be single or multiple conditions for a stepin the testing procedure. The steps make up the testing procedure, andeach step can contain any number of actions and associated conditions.In the test procedure creation of environment, signals or variables canbe monitored and compared against defined limits. Alerts can then beenabled such that on occurrence during testing, the user receives anindication that the monitored signal or variable has exceeded the boundsset.

FIG. 17 illustrates a graphical icon 200 that represents generation ofan information message to any remote computing device user that ismonitoring the testing device during testing. As with the othergraphical icons described in US Published Patent Application2010/0077260A1 graphical icon or box 200 can be inserted anywhere in thetest procedure work flow, for example, using an input pointer such as amouse to drag the box 200 into position in the schematic representationof the testing procedure. The test procedure designer can then indicatethe content of the information message to be rendered typically theaction portion 16 illustrated in FIG. 1. In the embodiment illustrated,the graphical user interface 202 includes a menu 204 that is accessibleupon selection or other indication that the testing procedure designerwould like to define the information message to be generated. Menu 204allows the test procedure designer to enter a name of the informationmessage generator displayed on the graphical user interface 202 at 206.Selectively, the testing procedure designer can enable or disable theinformation message generator at 208. A description or comment field isprovided at 210. The content of the information message can be definedat 212, which can be further based on a variable if desired such as thenumber of cycles completed during the test. In the embodimentillustrated, the message at 210 is a fixed or static descriptionindicating that the testing device has “Completed 25 cycle.” If desired,the information message generator module can incorporate a parameter orvariable value during testing (not shown in the illustrative embodiment)so that when the testing device reaches the information generator boxduring operation of the testing procedure, the value of the parameter orvariable can be obtained and included in the information message. Asindicated at 212, an alert can also be associated with the informationmessage generator 200. The alert can be enabled or disabled. Referringto the exemplary screen shot for the user interface 10 of the remotecomputing device at 214 if the information message has an alert enabledit is represented herein by rendering of a graphical icon comprising thebell illustrated in information message 12A of FIG. 1. It should benoted that an information message is not the same as an alert, butrather, an alert herein is communication to an individual interested inthe operation of the testing device; however, alerts herein are sent viaother communication methods such as by email or text message, by way ofexample. On the information message 12A, the graphical icon of the bellindicates to the remote computing device user that an alert has beensent.

In an exemplary mode of operation, when the test procedure is beingexecuted and each step is run according to the rules of the testprocedure design, whenever the test procedure gets to object 200, theinformation message is constructed if based on variables, and sent tothe remote computing device directly or via the server platform “e.g.internet cloud” to the interested remote users who will then see theinformation message on their display. If the alert button 212 waschecked, the message additionally gets sent via email, txt, or otherpush notification technology to users based on user alert settingspreviously defined, such as defined when the test procedure isinitialized. This is particularly useful for receiving periodic orimportant updates about the status of a test. For example, if the testis switching from Stage 1 (warm-up cycle) to Stage 2 (high cycle), thenan informational message box can be placed in the graphicalrepresentation of the test procedure stating for example “CompletedStage 1 warm-up and moving to Stage 2 (high cycle).”

Testing devices and their components, like any machine, have certainoperating parameters within which they are typically operated. Operationoutside of one or more of those parameters can be an indication that thedevice itself may be approaching a failure condition. Health monitoringof, for example, testing devices and their components, can determine inmany situations that a failure of the device or component may be morelikely, or even imminent. Using an alert, as discussed herein, users maybe notified of an impending potential or imminent testing devicefailure. As with all alerts, individual users may determine and definetheir own alert settings. Health information in one embodiment isdisplayed within an equipment profile page. As is known in the art,components may include, by way of example only and not by way oflimitation, a power supply for one or more testing devices such as ahydraulic power unit (HPU) or electrical power source. The parametersthat can be monitored include pressures, temperature of operation,number of hours since last service, and the like.

Referring to FIG. 18, additional information concerning the testingprocedure being performed on the testing devices is also available formonitoring by the remote computer user in one embodiment. Thisinformation can include operational information regarding the testingprocedure or testing device or test variables being tested or present inthe testing procedure. In addition, the test steps can be displayedremotely, highlighted to show the steps the test is currently on. Thisallows the remote user to be able to tell exactly where in the testprocedure the test is currently at.

Suitable computing environments are described in the aforementioned USpublished patent applications. Briefly, the description and figuresherein can be implemented at least in part, in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by a computer. Generally, program modules include routineprograms, objects, components, data structures, etc., which performparticular tasks or implement particular abstract data types. Thoseskilled in the art can implement the description and figures tocomputer-executable instructions. Moreover, those skilled in the artwill appreciate that embodiments of the invention may be practiced withother computer system configurations, including multi-processor systems,networked personal computers, mini computers, main frame computers, andthe like. Embodiments of the invention may also be practiced indistributed computing environments where tasks are performed by remoteprocessing devices that are linked through a communications network. Ina distributed computer environment, program modules may be located inboth local and remote memory storage devices.

The computer can comprises a conventional personal, mobile, tablet,smart phone, etc. having a central processing unit (CPU), memory and asystem bus, which couples various system components, including thememory to the CPU. The system bus may be any of several types of busstructures including a memory bus or a memory controller, a peripheralbus, and a local bus using any of a variety of bus architectures. Thememory includes non-transitory read only memory (ROM) and random accessmemory (RAM). A basic input/output (BIOS) containing the basic routinethat helps to transfer information between elements within the computer,such as during start-up, is stored in ROM. Non-transitory computerreadable storage devices, such as a hard disk, an optical disk drive,ROM, RAM, flash memory cards, digital video disks etc., are coupled tothe system bus and are used for storage of programs and data. Commonly,programs are loaded into memory from at least one of the storage deviceswith or without accompanying data.

An input device such as a keyboard, pointing device (mouse), touchsensitive screen or the like, allows the user to provide commands to thecomputer. A monitor or display or other type of output device is furtherconnected to the system bus via a suitable interface and providesfeedback to the user. Communications are provided based on programmodules executed by the computer and through a suitable interfacecoupling the computer to networks and other computing devices.

A platform on which embodiments of the present disclosure may bepracticed is shown in FIGS. 20-33. Test machines are used to testperformance of consumer products, electronics materials, medical andother devices. FIG. 20 illustrates a test device or device 130 used tomeasure parameters or performance of a material specimen 1102 secured toa frame 1104 of the test device 130. The test device 130 shown includesan actuator 1106, which is energized to apply loads to the specimen1102. In the embodiment shown, the load is applied to the test specimenthrough a movable cross-head 1108 coupled to the frame 1104 of the testdevice. The input force is measured by a load cell 1110 positioned inthe load path of the actuator 1106. The test device 130 includes varioussensors and transducer devices 1112 to measure response to the loadinput. In the illustrated embodiment, a sensor 1112 such as a straingauge is coupled to the specimen to measure strain. The test deviceshown also includes a Linear Voltage transducer 1114 to measure inputdisplacement.

As shown, operation of the actuator 1106 is controlled via a servocontroller 1116 via input from a system controller 134. The servocontroller 1116 and system controller 134 shown include various hardwareand software components to implement control functions of the testdevice 130. Feedback from the sensor or load cell 1110, 1112 is providedto the system controller 134. As shown, the system controller 134 iscoupled to a computer system 1120 or controller 134, such a PC computingdevice including one or more hardware components. Connection of the testdevice 130 to the computer system 1120 or controller 134 provides aprogram interface to define and set the control parameters for the testdevice 130. As shown, the computing device or PC 1120 or controller 134includes non-volatile system memory 1122 and various non-removable datastorage devices 1124 and removable data storage media 1125 operablecoupled to a processing unit 1126 through a bus structure 1128.Illustrative storage media includes solid state memory devices, harddisc drives and other hardware devices

Operating system and other application modules are stored in systemmemory 1122. Various program modules are stored on non-volatile/nonremovable storage media 1124. For example, the various programs storedon media 1124 include a test platform 1130 as well as mobile testplatform modules or tools configured to implement various functions ofthe mobile test platform as described. Additional data and programs arestored on the various removable and/or non-removable storage devices. Auser interfaces with the computing device 1120 or controller 134 throughinput devices 1140 and a display device 1142 (schematically shown) tocontrol operations of the test device 130. Illustrative input devicesinclude one or more of a keyboard, touch screen, pointing device,microphone or mouse and illustrated display devices 1142 include amonitor having a graphical user interface displayable on a displayscreen, such as a LCD screen. The computing device 1120 or controller134 interfaces with the system controller 134 of the test device througha controller interface 1144. Illustratively, the controller interface1144 can be implemented through a USB port. The computer 1120 orcontroller 134 is also connected to a wide area network or world wideweb (Internet) through a network interface or modem 146 to accessinformation through the Internet.

The test platform modules 1130 include application programs that allowthe user to input test parameters and specification through the graphicuser interface on the display device 1142. The test parameters definetime, duration and force profile to be applied to the test specimen1102. Different load or test profiles can be applied depending upondifferent test criteria. For example, the test criteria can specify astatic load for a specified duration followed by intermittent cyclicalload. Based on the input test parameters the test platform modules 1130generates control parameters which are provided to the system controller134 to provide control commands to the actuator 1106 or other testsystem components. Output from the sensors 1112, LVDT 1114 or load cell1110 provides feedback to the system controller 134 or servo controller1116 to provide closed loop feedback control of the actuator 1106 ortest device. Output from the sensors 1112, load cell 1110 and otherdevices is also transferred to the computing device 1120 or controller134 and stored to one or more of the data storage media to store of testdata for analysis and review.

In the embodiment shown, the test device 130 communicates with a remotetest platform 1150 implemented through a remote server or cloudcomputing platform to provide remote access to test data and operatingstatus of the test device 130. The remote test platform 1150 shown isimplemented on computing device(s) similar to computing device 1120 orcontroller 134 and includes remote platform modules or tool 1152operable on the computing device(s) to provide access to device data andoperation status of test device 130 to one or more remote computingdevices described below.

As shown, remote platform functions are implemented through mobile testplatform modules and operating tools 1152 on the computing devices 1120or controller 134 and/or system controller 134. The mobile test platformmodules or tools 1152 are configured to interface with control units orI/O signals from various device components including the actuator 1106,LVDT 1114, sensor 1112 and load cell 1110 shown in FIG. 20 to retrievedata which is transmitted to the remote platform 1150 through a remotecommunication platform 1154 to provide mobile or remote access to testdevice 130 and various types of data of the test device 130. As shown,test data, including data from the sensor, load cell, actuator andsensors is provided from the system controller 134 to the remote testplatform 1150 for access by remote or mobile computing devices, such asbut not limited to mobile or cellular phones 156, tablets 157, laptop orportable computers 158 and remote desktop computers (not shown in FIG.20), each of which can have functional elements similar to that ofcomputing device 1120 or controller 134. In the illustrated embodiment,the remote test platform 1150 is external to a fire wall 1164.

Data is transferred via the remote communication platform 1154 to theremote test platform 1150 through a communication interface or port ofthe controller (not shown) or computer device over a communication link.Illustratively the communication link is a cable or wirelesscommunication link or combination of a cable and wireless communicationlink. Large amounts of test data and/or status events can be transmittedusing a real time streaming protocol or long polling algorithms such asComet algorithms or Websocket Protocol, for example to respond to datarequests from mobile or remote computing devices to provide test data tothe remote or mobile devices. As shown, data from test device 130 suchas test data is stored to a data cache 1160 or data store 1162 of theremote test platform 1150 at least temporarily or otherwise in a mannerwhere it can be transmitted to one or more of the mobile or remotedevices as shown in FIG. 20. In other words, data from test device 130such as test data and/or status events (e.g. whether the test device 130is performing the test or has stopped) can be transmitted through theremote test platform 1150 to one or more of the mobile or remote devices156 and rendered to the user thereof in real time. As used herein, “realtime” means the data is rendered without intentional delay, given theprocessing limitations of the components of the overall system and thetime required to accurately measure or otherwise ascertain the data. Inthe embodiment shown, remote communication platform 1154 is part of thecontroller 134 but as will appreciated by those skilled in the art couldbe implemented as a separate unit or through the computing device 1120or controller 134. Moreover, it should be understood that the depiction,arrangement and/or description of all of the various modules,interfaces, components and the like herein are done so for the purposesof understanding the purpose or role of such elements and should not beconsidered limiting, but rather that such modules, interfaces,components and the like can be combined together or separated asdesired. Illustratively the mobile test platform modules 1152 implementvarious functions such as setting alerts, implementing maintenancefunctions, status updates and remote access to test data. As previouslydescribed, test data can be transmitted as a data stream to remotecomputing devices and decoded by a real time player or decoder. Thedecoded data is displayed on a GUI display 182 of the remote computingdevice. In one embodiment, the mobile test platform modules 1152 includea summary algorithm to generate summary data from the i/o data orotherwise pertaining to the test device 130 for transmission to theremote test platform 1150 and subsequently to a mobile or remote device.For example, mobile test platform modules 1152 can include a computerbased procedure to gather certain data stored in the system controller134 and/or computing device 1120 or controller 134 relevant to a problemoccurring on the test device 130, summarizing such data and/or packagingsuch data, which is then provided to remote technical support personnelfor diagnosing and/or servicing the problem.

In yet another embodiment, mobile test platform modules 1152 can includea computer based procedure herein illustrated as a usage tool 366 (FIG.33) to gather information related to usage of the test device 130 suchas but not limited to amount of time the test device 130 was operatingand/or performing a test, the number of cycles of the actuator(s) 1106overall, and/or related to the level of performance or usage that thetest device was run at, for example, as measured with reference to themaximum capabilities of the test device 130 such as amount of time thedevice was operated above a certain level (e.g. based on full loadcapabilities of the actuator(s) such as overall time operated with theactuator(s) applying 25% or less of full load, overall time operatedwith the actuator(s) applying between 26% to 50% of full load, overalltime operated with the actuator(s) applying 50% or more of full load;based on cyclical rate of the actuator(s) such as overall time operatedwith the actuator(s) cycling at less than 10% of maximum rate, overalltime operated with the actuator(s) cycling at a rate between 11%-75% ofmaximum rate, overall time operated with the actuator(s) cycling at 76%or more of the maximum rate; and/or based on a level of hydraulic powerneeded to operate the test device 130 such as overall time operatedrequiring 10% or less of full load capabilities of the hydraulic powersupply unit (not shown) powering the test device 130, overall timeoperated requiring between 11%-25% of full load capabilities of thehydraulic power supply unit, or overall time operated requiring morethan 26% of full load capabilities of the hydraulic power supply unit,where the cited examples or not intended to be a complete list of eachpossible parameter, but rather merely examples).

At this point it should be noted that the foregoing examples of usage ofthe test device 130 can also serve as a basis for ascertaining the priceto be paid by the user, at least in part. For example, any or all of thecited examples of usage or other parameters or measures indicative ofusage can have an associated cost such as each percentage or range ofpercentages of usage has an associated cost, where higher demands placedon the test device 130 have a corresponding higher cost. Then, the totalcost to the user for using the test device 130 or other associatedequipment such as the hydraulic power supply unit, for example, for anydesired time period can be calculated by adding together the costs foreach individual time of usage, an invoice or the like can then begenerated and reported to the owner of the equipment.

In yet a further embodiment, any or all of the foregoing measures orother measures of usage can be used by maintenance tool 360 to ascertainwhen service or maintenance is required for the test device 130. Forexample, any or all of the cited examples of usage or other parametersor measures indicative of usage can have an associated wear or damageunit such as each percentage or range of percentages of usage has anassociated wear or damage unit, where higher demands placed on the testdevice 130 have a corresponding higher wear or damage unit. Then,maintenance can be based on when a certain amount of wear or damageunits have been obtained, or other thresholds with respect to themeasures of usage have been exceeded. The ability of the mobile testplatform modules 1152 on each test machine 130 in communication with theremote test platform 1150 for delivery to a remote computer usercommunicating with the remote test platform 1150 based on a schedule orbased on request is particularly useful, advantageous and/or efficient.If desired, data indicative of usage and/or data indicative of wear ordamage units together with information already known about the teststation, test device or related equipment such as but not limited toage, model, and accessories, can be used by a tech support tool 362and/or product/accessory support tool 364 (FIG. 33) to generate anestimate of the costs for an upgrade, or an estimate of the value ofsaid equipment, which can be provided directly or indirectly viaplatform 1150 to the test device user and/or one or more remote ormobile computing devices.

A user can interface with the remote computing devices through variousinput devices such as touch screen input devices or keyboards toremotely access test data and status information. Thus, as described,the mobile test platform provides the user with remote/real time accessto the status of testing operations while away from or remote from thetest device. In one application, the devices link to the data in theremote test platform 1150 through an Internet URL address. The URLaddress includes address location of the remote test platform 1150 andaddress information identifying the user and the specific test device.Thus, the remote test platform 1150 processes the URL address to locateand transmit the specific test data or test information for the user'stest device.

The mobile or remote computing devices use one or more mobileapplication tools 1155 to access the remote test platform 1150.Illustratively, the mobile application tools 1155 include instructionand code to input URL or user or device identification to interface withthe user's test station or devices 130. The mobile application tools1155 also include instructions to process test data from the data streamand generate the graphical user interface display on the mobile phone156, tablet computing device 157, portable computing device 158 or otherremote computing devices not shown in FIG. 20. The mobile applicationtools 1155 can be downloaded from the remote test platform 1150 andinstalled in the remote computing device. The test platform definesdifferent data types, objects and GUI displays for different devices.The mobile phone, tablet or other computing devices use objects and codeto display the test data and interface with the test platform toretrieve and request data.

In particular, the tools include a logon function to receive an accessinput such as a username and password or other access input such as anembedded code on a chip or bar or QR code. It should be noted thatapplication of the embodiment illustrated in FIG. 20 is not limited to atest machine of the type illustrated in FIG. 20. For example in analternate embodiment, data from a controller for an orthopedic testsystem can be transmitted to the remote test platform for remote access.

FIGS. 2-3 illustrate a communication sequence for interface between oneor more test devices 130-1, 130-2 at a test facility separated from theremote test platform 1150 by firewall 1164 or electronic screeningapplication. As shown in FIG. 21, the mobile communication platform 1152is programmed or configured to generate an outbound message to theremote test platform 1150. The outbound message 1200 may be generatedbased upon a system status change, such a test completion status, alertstatus or maintenance status. In response to the outbound message 1200,the remote test platform 1150 generates a message reply 1202 to requesttest or other data. In response to the message reply, the remotecommunication platform 1154 transmits the requested data such as statusalerts, test data, maintenance data or other data. As shown in FIG. 21,in response to the outbound message 1200, the remote test platform 1150determines if any remote or mobile computing devices are requesting dataand or an alert is pending and if so (or requests first initiated by themobile or remote device 156) generates the reply message 1202 for therequested data. As indicated above such messaging can be performed usinglong polling or Websocket protocols. Data can be requested by the mobileor remote computing device to the remote test platform 1150 throughactivation of a status alert or data request function inputted by a userthrough input devices of the computing device 1120 or controller 134 orvarious remote computing devices 1204.

FIG. 22 illustrates the communication sequence between the controller134 or test device 130 and the remote test platform 1150 as previouslyillustrated in FIG. 21. As shown in step 1210, the communicationplatform 1154 generates the outbound message 1200 to the remote testplatform 1150 to invoke an inbound reply message 1202 (albeit possiblydelayed in time) for data from the remote test platform 1150. Theinbound or outbound messages can include a requested data type fortransmission. In step 1212, the communication platform 1154 receives theinbound reply message 1202. In response to the inbound reply message1202, the remote communication platform 1154 interfaces with controller134 to retrieve and format test data or information from the controller134 using if needed mobile test platform modules 1152 as exemplifiedabove in step 1214. In step 1216, the communication platform 1150transmits the data to the remote test platform 1150. The outboundmessage 1200 can be generated based upon a change in test status or inresponse to an alert implemented via mobile platform modules 1152 inresponse to user input, or otherwise sent repeatedly waiting for aremote or mobile computer user to inquire upon its status or currentlocation in a test performed on a test specimen. In response to theoutbound message 1202, the remote test platform 1150 can poll orotherwise wait for a request from the remote or mobile computing devicesto determine if a data request or alert is pending and generates thereply message 1202 to request data to respond to the data request oralert for particular test device(s) at a particular test facility.Illustrative data includes run state, interlock state, signal values andstation logs, hydraulic power unit on/off status, and low/high status,test status, test running time, cycles completed, force data,displacement data, maintenance alerts, failure data, commanded forceand/or displacement data, a test run/hold/stop status or other data. Therequests made upon the test device 130 can come from and be provided toone or more mobile devices 156, where requests made upon the test device130 can be different for each mobile device user. The remote testplatform 1150 can maintain user account information for each user thataccesses the remote test platform indicating which test device 130 orcollection of test devices 130 the user has authority to access as wellas information pertaining to what authorized requests can be made uponeach or a collection of test devices 130.

In one embodiment, the remote test platform 1150 maintains a queue foreach test device 130 connected thereto containing all requests made tothe test device 130 from one or more users of the mobile or remotedevices 156. The requests can be embodied in the remote reply messages1202 in first-in-first-out basis, or based on some priority if desired.It should be noted that the requests made to the test device 130 and theresponses therefrom need not be limited to inquiring as to the status,obtaining real time test data, or summary of information as describedabove, but could also take the form of communications between the mobiledevice user(s) having access to the test device and/or the operator ofthe test device 130. Such communications can be text messages, imagemessages, audio and/or video clips rendered to each of the users usingthe GUI and necessary hardware (e.g. monitor and/or speakers) dependingupon the hardware and processing capabilities of the mobile computingdevice 156, the remote test platform 1150 and the remote communicationsplatform 1154. Communication provided through the remote test platform1150 when the user of the test device 130 and/or the users having accessto the test device 130 is particularly efficient since one or both users(which can also include communications just between users of mobiledevices 156) attention is focused on performance or use of the testdevice 130. Likewise, in situations when such users may not be at thetest device 130 or a remote user is not connected to receive data fromthe test device 130, messages can be stored, for example, at the remotetest platform 1150 and provided to the user at the test device 130 orwhen connection is made with a remote or mobile device 156. Again, thisis particularly efficient since notification and/or delivery of thestored communication is provided when the user's attention is nowfocused on the test device 130. The GUI can initiate capture orrecording of each of the various types of communications with selectionof a corresponding button or the like by the user on the GUI.

FIG. 23 illustrates a test application for a test facility having aplurality of test devices at a plurality of test stations 1220. In theillustrated embodiment the controller 134 communicates with the testdevices of a plurality of test stations 1220, 1222 through one or morecommunication channels 1224, 1226 connected to each test station (onlyone shown in FIG. 23). The controller 134 transmits input commands andoutput over the one or more communication channels to interface with oneor more control units of the testing device such as sensor, actuator,load cell and LVDT (not shown in FIG. 23). Illustrative input/outputincludes commanded force or displacement and feedback force ordisplacement. The controller receives i/o data from the control unitsand provides the data to the mobile communication platform 1154 throughthe communication channels 1224, 1226 for transmission to the remotetest platform 1150. As shown, PC computers 1120 or controller 134 foroperating each of the test stations 1220, 1222 can be connected to thecontroller 134 through a router 1230 or connected directly to thecontroller through, for example, a USB port connection or directethernet connection. In the illustrated embodiment, the controller 134includes a user interface 1232 to activate various functions of themobile test platform.

FIG. 24 illustrates another embodiment of a test device implementing amobile communication platform as previously described. In the embodimentthe testing apparatus or device has an ID code 1200 (identification) todistinguish multiple test devices and the data therefor. The ID code isassociated with an image such as a bar or QR code 1202, which is affixedto the test device 130. The pattern of the image or bar code is storedin memory of the system controller 134 or computing device 1120 orcontroller 134 shown and the remote test platform 1150. Test data fromthe device is stored in the cache or data store 1160, 1162 of the remotetest platform utilizing the ID code 1200. As shown, the mobile device(or other remote computing device—not shown) equipped with a camera 240is used to access data utilizing image or bar code 1202 affixed to thetest device 130. The camera 242 captures an optical image 244 of the barcode 240 and provides a digital image of the bar code to a readerapplication 245. The digital image is processed by the readerapplication 245 to provide an alphanumeric URL code 240 or the likewhich is used to access information or data for the test device 130 fromthe remote test platform 1150. In alternate embodiments, near fieldcommunication tools are used to provide the code. In such embodimentsthe mobile or remote computing device uses a radio to retrieve anembedded code on a chip (NFC chip or tag) when the radio is held closelyto the chip. The code is then used an the access input to accessinformation or data for the test device through the remote or mobilecomputing device.

In the embodiment illustrated in FIG. 25, each of the components of thetest device 130, including sensor, actuator, LVDT, and load cell andcontroller components include identification codes. In the embodimentshown, components of the test machine are identified by separateidentification or image codes. In particular as shown, the actuator,load cell, LVDT, frame and various sensors include codes to accessspecific data for each of the components separately. The specific datacan be used to perform maintenance checks as previously described orretrieve technical data. The image or bar codes on the actuator 1106,load cell 1110, LVDT 1114 and sensor 1112 provides a component ID or URLseparate from the device 130. Data transmitted includes an associateddevice ID or component ID to distinguish the source of the data. A usercan access test or maintenance data for the device or any component ofthe device 130 using the image or bar codes as previously described withrespect to FIG. 24.

FIG. 26 illustrates method steps for accessing the test data on theremote test platform 1150 through a mobile or remote device using thecamera 242 on the mobile device and image or Q/R code (e.g. matrix barcode) affixed to the device 130. As illustrated in step 250, an inputimage of the bar code is captured via the camera 242 to generate adigital image 244 of the bar code. The digital image is processed by abar code reader 245 as illustrated by step 252 to provide the device IDor code. In step 254 an interface to the remote test platform is invokedto transmit the code and mobile device address. As illustrated by step256, the mobile or remote device receives data feeds or alerts for thetest device corresponding to the device code or URL address.

FIG. 27 illustrates an embodiment of a GUI display bar 260 which can bedisplayed through the display device 1142 of the computing device 1120or controller 134 or through a display device of the system controller(not shown). The GUI display bar 260 is implemented through the testplatform modules or tools 1152 on the computing device 1120 orcontroller 134 or system controller 134. As shown the GUI display bar260 allows the user to enable/disable alerts, send the URL for the testlab or facility to remote computing devices using e-mail or textmessaging and change or set equipment states for the test device(s). Inparticular selection of message icon 261 allows the user to e-mail ortext message a link through the PC computing device 1120 or controller134 in the lab to the user's remote computing device. Selection of thelink retrieves data and information for the test devices to provide aGUI display as shown in FIGS. 28-30 on the user's remote computingdevice.

FIGS. 28-30 illustrate various GUI displays for remote computing devices1204 to provide access to test data and status. As previously described,the remote test platform or system can be utilized to provide data toremote computing devices such as desk top computer, portable computersor tablets. To provide remote access, the computer or tablet includesthe mobile application tools 1155 and modules to access test data,status information and activate alerts. The tools or modules on thecomputer or tablet are configured to generate various GUI to interfacewith the mobile or remote test platform 1150. The GUI 270 illustrated inFIG. 31 illustrates a lab view display to recreate the layout of a testlab or facility 272 including a plurality of test devices or stations130. Such a GUI being representative of the physical locations orgeneral layout of the test devices in the test lab or facility 272 isparticularly useful since the user of such a display can more readilyand/or accurately identify a desired test device to which requests willbe made because the position and/or relationship of icons for the testdevices 130 on the GUI corresponds to that of the test facility 270. Asshown the GUI 270 includes menu portion 272 and a display portion 276.The menu portion 274 includes a menu of test devices or equipmentselections 276 in addition to non-test device icons such as lab andfurniture selections 278. The ability to include non-test deviceicons/elements in the GUI further aids the user in readily andaccurately identifying the correct test device icon for the desired testdevice to which requests are made. As shown, the lab and furnitureselections 278 include desk icons, chair however, application is notlimited to particular furniture articles but can include structuralelements of the lab facility such as walls (exterior and/or interior),partitions and the like as well as elements therein such as windows,doors or other openings.

To interface with the GUI 270 shown, an input or pointing device is usedto select and position the test device and, if desired, non-test deviceicons (e.g. furniture) selections 277, 278 on the display portion 276 torecreate the actual arrangement or layout of the lab 272. Thus, user canarrange the display portion 276 to match the arrangement of the teststations in the lab so that the user has a quick reference to varioustesting devices 130 based upon location in the physical laboratory orfacility. In the illustrated embodiment, the test device selections 277include test stations or device icons corresponding to actualrepresentations in the lab. The icons or selections for the test stationare generated based device information for the test stations transmittedfrom the remote test platform 1150 to the GUI 270 utilizing URL or otheridentifications for the one or more test devices or facilities.

As appreciated by those skilled in the art the user or labidentification can be transmitted through a URL address or the user orlab identification can be inputted in response to an input prompt aswell as through bar codes as previously described. FIG. 29 illustrates alab view summary 280 of each of testing devices for one or more testingstations. As shown, the lab view summary 280 provides the computingdevice for each testing device, communication channels or station, runtime and other information. A user can toggle between the lab overview270 and lab summary 280 via input selections 285, 286. FIG. 30illustrates a GUI for a single station view 290 for a particular testdevice. As shown, the single station view provides more detail dataincluding command and feedback data. The single station view 290 isgenerated using a drill down function upon selection of a single testdevice icon or selection. Data for the single test device is retrievedfrom the remote test platform 1150 in response to activation of thedrill down function using for example using communication protocolspreviously described.

FIG. 31 illustrates an alert notification implemented through an alertfunction of the mobile test platform tools 1152. In the illustratedembodiment, the alert function is a test complete function alert. Asshown, implementation of the alert/notification function generates theoutbound message 1200 to the remote test platform 1150. In response tothe message 1200, the remote test platform 1150 generates the replymessage 1202 to request the alert/notification. Alternatively, the testplatform may send a notification to the remote test platform whenever asignificant event occurs. The remote test platform will determine if anymobile device or user wants to be alerted of this event. If so then theremote test platform 1150 alerts the mobile or remote computing devicethrough appropriate methods. As previously described, in response to thereply message 1202 the notification data is transmitted through theremote test platform to the mobile device. As shown thealert/notification display 295 includes a notification that the test runfor Station I is complete and includes a link 296 to view a data log forthe test data store in the remote test platform 1150.

In illustrated embodiments, the test platform can send a message 1200 tothe remote test platform 1150 requesting which things it should watchand tell the remote test platform about when they happen. The testplatform can then monitor these things (e.g. such as a limit on asignal) and will send a message to the remote test platform 1150 whenthat specific trigger occurs. The remote test platform 1150 can then actaccordingly and alert remote devices or users that the trigger hasoccurred. This method is helpful when alerts are requested faster thanthe test platform can send them to the remote test platform 1150, or toreduce bandwidth so the test platform 1150 can make the decision of whenthe alert occurs instead of delaying the decision until the remote testplatform gets the information.

FIG. 32 illustrates an exemplary messaging function implemented throughmobile test platform modules and tools 1152 as previously described. Asshown, a user at the test station can enter a message post 300 though asticky note via input devices of the computing device 1120 or controller134. In response to the input message post 300, the communicationplatform 1154 transmits the message to the mobile or remote computingdevice utilizing communication protocols previously described.

FIG. 33 illustrates a cloud based maintenance or service platform 350.In the illustrated embodiment, the platform is used to monitor and/orservice multiple stations at sites A and B 352, 354. As shown andmentioned above, the platform 350 includes the maintenance tool 360,tech support tool 362, product/accessory support tool 364 and usagemeasurement tools 366. The tools are configured to interface withpowered devices, such a hydraulic actuators or other power devices atsites A and B via communication protocols as previously described. Themaintenance tool 360 uses maintenance data from controller units ordevices of site A or Site B to issue maintenance alerts and schedulemaintenance procedures. Maintenance data can be calculated based upondamage unit calculations using hours of use to calculate the maintenancestatus as, cycle counts, the amount of force applied over a time periodwith higher forces accounting for example previously described moredamage units than smaller forces.

The tech support tool 362 utilizes technical information for stationdevices to provide technical support to users through remote computingdevice 1204 or mobile devices. The type and model of the devices areidentified based upon associated device and station codes. The productsupport tools 364 provide product or accessory suggestion for users ofstation or test devices through the GUI at the test device 130 and/orthe mobile and remote devices 156. For example, tech support tool 362generate a message and sent to the remote test platform 1150, which isthen subsequently rendered by the station device, test device and/ormobile device 156 having a known association with the testing device130. The corresponding GUI can generate a button, link, icon or otherform of user selectable feature to obtain further information related tothe message. For example, activation of the user selectable feature candirectly or indirectly (through the remote test platform 1150)transmitted to the tech support tool 362. The tech support tool 252 canthen transmit further information concerning the possible accessory(such as connecting the user to an online catalog or personnel equippedto take the order and/or answer questions), product update information,information concerning maintenance just to name a few type of furtherinformation. Usage tools 366 can automatically interface with thenecessary controllers to retrieve usage parameters related to thecurrent state of the test device or test station, such as but notlimited to use time or cycles for the device if such current stateinformation is needed by the tech support tool 362. Information from thetools 360, 362, 364, 366 can be broadcasted to remote computing device(not shown) or mobile device as previously described. As shown,information from the tools is also transmitted or broadcasted to amanagement device 370 for central control. Management device 370 can bea desk top computer or server. Maintenance information provided to themanagement device is used to monitor and schedule maintenance forstation devices. Usage information provided to the management device 370can be used to monitor service agreement and determine billing amountsfor a service contract based upon usage.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above ashas been held by the courts. Rather, the specific features and actsdescribed above are disclosed as example forms of implementing theclaims.

What is claimed is:
 1. A method of remotely monitoring a test beingperformed upon a test specimen, the method comprising: receivinginformation pertaining to the test; rendering on a display of acomputing device remote from the testing device an information messagehaving a first portion indicative of a testing device, a second portionindicative of information related to the testing device or a test beingconducted on the testing device, and a third portion indicative of timethat has elapsed since the second portion has occurred; and updating thethird portion indicative of the time that has elapsed.
 2. The method ofclaim 1, wherein the information pertaining to the test includes anindication of a test failure, and wherein rendering further comprisesrendering an information message about the failure.
 3. The method ofclaim 2, wherein the information pertaining to the test includes animage or video of the failure, and wherein rendering further comprisesrendering a link to the image or video of the failure.
 4. The method ofclaim 1, wherein the information pertaining to the test includes animage or video of the testing operation, and wherein rendering furthercomprises rendering a link to the image or video.
 5. The method of claim1, and further comprising receiving information pertaining to an alertpertaining to the test, the testing device, and/or a componentassociated with the testing device, and rendering the alert on thedisplay.
 6. The method of claim 1, and further comprising rendering onthe display a series of information messages in a time ordered fashionsuch that each third portion of each information message in the seriesof information messages continues to indicate the elapsed time from thecorresponding second portion of each information message as theinformation message is rendered on the display.
 7. The method of claim6, wherein the series of information messages relates to informationprovided by at least two different testing devices.
 8. The method ofclaim 6, wherein the series of information messages relates only totesting devices, a component connected thereto, and/or communicationbetween users authorized to monitor the information messages.
 9. Themethod of claim 1, and further comprising associating graphical iconsfor information messages.
 10. The method of claim 1, and furthercomprising associating images of a testing device with an informationmessage for that testing device.
 11. The method of claim 1, and furthercomprising receiving information from the user of the computing deviceindicating at least one parameter associated with the testing device, acomponent connected thereto, and/or communication between usersauthorized to monitor the information messages to be sent in aninformation message.
 12. A computing device, comprising: an interfaceconfigured to receive information pertaining to a test performed on orrelated to a testing device; a storage device; a display; and aprocessor operably connected to the interface, the storage device andthe display, the processor configured to receive information pertainingto the test; to render on the display an information message having afirst portion indicative of the testing device, a second portionindicative of information related to the testing device or a test beingconducted on the testing device, and a third portion indicative of timethat has elapsed since the second portion has occurred; and to updatethe third portion indicative of the time that has elapsed.
 13. Thesystem of claim 12, wherein the processor is further configured toreceive an image or video associated with the testing operation, and torender on the display the image or video associated with the testingoperation.
 14. A system configured to monitor a testing operation on atesting device, comprising: an image capture device; and a computingdevice operatively connected to the image capture device to receiveinformation on the testing operation from the image capture device, thecomputing device having a controller configured to receive informationpertaining to the testing operation and to render on a display aninformation message indicative of parameters of the testing device at aselectable amount of progress through the testing operation.
 15. Asystem configured to monitor a testing operation on a testing device,comprising: an image capture device; and a computing device operativelyconnected to the image capture device to receive information on thetesting operation from the image capture device, the computing devicehaving a controller configured to receive information pertaining to thetesting operation; to render on the display an information messagehaving a first portion indicative of the testing device, a secondportion indicative of information related to the testing device or atest being conducted on the testing device, and a third portionindicative of time that has elapsed since the second portion hasoccurred; and to update the third portion indicative of the time haselapsed.
 16. The system of claim 15, wherein the image capture device isconfigured to capture images of the testing operation, and to convey tothe computing device images associated with the testing operation. 17.The system of claim 16, wherein the image capture device is configuredto convey images associated with a failure of the testing operation tothe computing device upon the failure.
 18. The system of claim 15,wherein the image capture device is configured to capture a video of thetesting operation, and to convey to the computing device videoassociated with the testing operation.
 19. The system of claim 18,wherein the image capture device is configured to convey videoassociated with a failure of the testing operation to the computingdevice upon the failure.
 20. The system of claim 15, wherein thecontroller is further configured to render on the display an alert for acondition of the testing device.
 21. A testing device; comprising: atest platform having a controller operatively coupled to the testplatform; an image capture device operatively coupled to the controller,to capture information pertaining to a test, the test platform, or atest specimen on the test platform; and wherein the controller isconfigured to generate an information message having a first portionindicative of a testing device of the one or more testing devices, asecond portion indicative of information related to the testing deviceor a test being conducted on the testing device, and a third portionindicative of time that has elapsed since the second portion hasoccurred.
 22. A mobile application tool including instructions stored ona computer storage medium and operable through one or more hardwarecomponents of a computing device, comprising: a mobile test interfacecomponent configured to retrieve an information message, from one ormore testing devices, associated with one or more tests operable on theone or more testing devices; and a display component configured toinvoke a graphical user interface to display the retrieved informationmessage, the information message having a first portion indicative of atesting device of the one or more testing devices, a second portionindicative of information related to the testing device or a test beingconducted on the testing device, and a third portion indicative of timethat has elapsed since the second portion has occurred.
 23. The mobileapplication tool of claim 22, wherein the tool includes an alertfunction which when activated retrieves alert notifications for the oneor more testing devices.
 24. The mobile application tool of claim 22,and further comprising an alert function to provide an informationmessage indicating a completion of a test cycle or test for a testingdevice of the one or more testing devices.
 25. A mobile data platformfor monitoring a testing system including one or more testing devicesoperated through one or more controller units, comprising: acommunication platform to receive information on one or more testsoperable on the one or more testing devices; and a display componentconfigured to invoke a graphical user interface to display the receivedinformation, wherein the received information is determined byparameters identified by an individual user for that individual user.26. The mobile data platform of claim 25, wherein the receivedinformation is rendered on the display component and includes aninformation message having a first portion indicative of a testingdevice, a second portion indicative of information related to thetesting machine or a test being conducted on the testing device, and athird portion indicative of time that has elapsed since the secondportion has occurred.
 27. The mobile data platform of claim 26, whereinthe received information third portion is updated indicative of the timehas elapsed since an event associated with the information message hasoccurred.